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ABSTRACT 

We analyze the flux power spectrum and its covariance using simulated Lya forests. We 
find that pseudo-hydro techniques are good approximations of hydrodynamical simulations 
at high redshift. However, the pseudo-hydro techniques fail at low redshift because they are 
insufficient for characterizing some components of the low-redshift intergalactic medium, 
notably the warm-hot intergalactic medium. Hence, to use the low-redshift Lya flux power 
spectrum to constrain cosmology, one would need realistic hydrodynamical simulations. By 
comparing (one-dimensional) mass statistics with flux statistics, we show that the nonlinear 
transform between density and flux quenches the fluctuations so that the flux power spec- 
trum is much less sensitive to cosmological parameters than the one-dimensional mass power 
spectrum. The covariance of the flux power spectrum is nearly Gaussian. As such, the un- 
certainties of the underlying mass power spectrum could still be large, even though the flux 
power spectrum can be precisely determined from a small number of lines of sight. 
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1 INTRODUCTION 

The Lya forest is a useful tool for studying the cosmic density field 
over a wide range of redshift that has not been easily accessible to 
other types of observations. For each line of sight (LOS) to a quasar, 
one can sample the density field almost continuously in one dimen- 
sion. With enough LOSs covering up to z ~ 6, the Lya forest will 
enable us to establish a more complete picture of the universe and 
its evolution, and, subsequently, to determine cosmological param- 
eters. 

Statistics of the Lya forest have been applied to many aspects 
of large-scale structure studies such as recovering the initial linear 



mass power spectrum (PS: ICroft etalj 1 1998L 11999c Huilll999t 
Feng & Fan J l200Ct iMcDonald et alj l2000l ho04rI Icroft et all 
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2002; Gnedin & Hamilton 2002; Zaldarriaga, Scoccimarro & Hui 



2003 ), measuring the flux PS and bispe c trum |Hu j*eHd* T20olT 
Mandelbaum et alj|2003l: iKim et alJEool IViel et alj|2004l). esti- 
matin g cosmological parameters McDonald & Miralda-Escude 
19991 IZaldarriaga. Hui & Tegmarkl 1200 lL ICroft et all 120021; 



- Seliak McDonald & Makarovl]2003t IViel et al 
2003llSeliak et al.l2004l:IViel. Weller & HaehneltfeOOllLidz et al 



2005 ), inverting the Lya t ( 
Pichon et aljboOll IZhart l2005t) 



forest iNusser & HaehnefJ 1 19991 
find ing the applicable range of 
clustering mo del jFeng. Pando & Fan j 1200 it 
Jamkhedkar & Fanj200ll) . and estimating the velocity field 
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IZhan & Fang||2002l) . These studies show that the Lya forest has 
provided an important complement to studies based on galaxy and 
QSO samples. 

In fact, the Lya forest is becoming a major player in pre- 
cision cosmology. It is one of the three measures (others being 
the cosmic m i crowa ve background and galaxy redshift surveys) in 
ISpergel etai]<2003l) that show a tantalizing hint of a possible run- 
ning spectral index, which could have a significant impact on in- 
flationary models. However, the degeneracy between the amplitude 
and slope of the flux PS that has arisen owing to uncertainties in 
the mean transmissio n weakens th e argument for a running spec- 
tral index fceliak. McDonald & Makarovl2003l) . This motivates us 
to pursue a better understanding of the uncertainties in the Lya flux 
statistics in the era of precision cosmology. 

A number of authors have examined the effects of metal lines, 
continuum fitting, strong discrete absorptions systems, damping 
wings, ionizin g radiation fluc t uations, galactic winds, and simu- 
lation details feui et alj|200l[: IViel et alj|2004 Ikeiksin & White] 
12004 IMcDonald et alj|2004a |b|). In this paper, we focus on the 
following facets of the Lya forest. Firs tly, we evaluate the perfor- 
mance of pseudo-hydro techniques (e.g. lPetitiean. Miicket & Katesl 
1 19951 ICroft et allll998h by comparing their results to those from 
full hydrodynamical simulations and by varying pseudo-hydro pa- 
rameters. We show that a systematic difference between pseudo- 
hydro and full-hydro results exists, which might cause a bias in 
cosmological parameter estimation. Thus, careful calibrations of 
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pseudo-hydro techniques over a large dynamic range are necessary 
for precision cosmology. 

Secondly, the Lya flux is a nonlinear transform of the one- 
dimensional density field. Fluctuations in the flux and the sample 
variance of the flux PS are much smaller than those of the density 
field. Consequently, one can measure the flux PS to a high precision 
with a small number of LOSs, but to achieve the same precision in 
the mass PS one needs a lot more LOSs. 

Thirdly, the Lya flux is nearly Gaussian, while the 
one-dimensional density field exhibits stark non-Gaussianity 
IZhan & Eisensteinll2005h . These are not characterized by the PS 
but by higher-order statistics such as the covariance of the PS. We 
quantify the correlation between Fourier modes in both flux and 
density fields using the covariance of the PS. 

Finally, we point out the difficulty with extending the Lya 
flux PS analysis to low redshift. Since the non-Gaussianity of the 
density field becomes stronger at lower redshift, one would need 
even more LOSs to recover the one-dimensional mass PS at the 
same precision that one would at high redshift. Meanwhile, pseudo- 
hydro techniques work poorly at low redshift so that one would 
have to utilize more time-consuming full-hydro simulations. 

The rest of the paper is organized as follows. (0 briefly de- 
scribes the simulations used for the investigation. The flux PS 
and its covariance are illustrated in [J3|and contrasted with one- 
dimensional mass PS and its covariance. Comparisons of flux PSs 
in different cosmological models are given in Sj4| and ^concludes 
the paper. Note that in our terms the flux PS is always the one- 
dimensional PS of the flux F, not F/F. 



2 SIMULATED IN a FORESTS 

The Lya forest probes deeply into the nonlinear regime of the 
cosmic density field. This has made numerical simulations indis- 
pensable for understanding the nature of the Lya forest and in- 
ferring cosmological parameters from flux statistics. Two types 
of cosmological simulations have been commonly used to sim- 
ulate the Lya forest. One is pure cold dark matter (CDM), or 



TV-body sim ulations, which assume that baryons trace the dark 
matter (e.g. IPetitiean. Mucket & Kates! [l995t ICroft et alj Il998t 
iRiediger. Petitiean & Miic ketHl998 [). The other is hydrodynami- 
cal simulations (e.g. ICen et alJll994t IZhang . Anninos & Normanl 
ll995UHemauistetalJll99dlDaveetalJll997l) . Although full hv- 
drodynamical simulations are well suited for studies of the Lya 
forest, they are currently too time-consuming to explore a large 
cosmological parameter space as one often desires. Whereas, N- 
body simulations run much faster, and hence can be used to 
cover a wider range of cosmological models in a practical time. 
Other types of simulations such as hydro-particle-mesh simula- 
tions (HP M.lGned in & Huill9 98) and the simple log-normal model 
iBi & Davidsenl 1997b have also been used to study the Lya forest. 

2.1 Hydrodynamical Simulations with Photoionization 

We use a hydrodynamical simulation (HLCDM) for this study. It 
is a variant of the low-density-and-flat CDM (LCDM) model with 
a slight tilt of the initial power spectral index n (see Table 0. 
HLCDM evolves 128 3 CDM particle s and 128 3 gas particles from 
z = 4 9 to using Parallel TreeSPH iDave. Dubinski & Hernquisl 
Il997l) . The box size is 22.222 /i -1 Mpc in each dimension with a 
5 h^ 1 kpc resolution. The simulatio n also includes star formation 
with feedback and photoionization jKatz. Weinberg & HernquisJ 
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The UV ionization background is from lHaardt & MadavJ 



We simplify the method in the software tool, TIPSY 1 , to pro- 
duce Lya forests. The procedures are outlined below. For conve- 
nience, we assume zero metallicity and do not include noise. 

Snapshots of the simulations contain the position r; and ve- 
locity v,: of each particle, where i labels the ith particle. Smooth- 
particle hydrodynamics (SPH) defines the baryon density pb (x) at 
any location to be a sum of contributions from all nearby gas parti- 
cles, i.e. 



/0b (x) = y^mjw(|x- 



(1) 



where N p is the total number of particles, w is the density kernel 
or the assignment function, m, is the mass of particle i, and t\ is 
the smoothing length determined by the distance between particle 
i and its jth neighbor (j = 32 in this paper). In practice, densities 
are assigned on a discrete grid for further analy sis. We employ a 
spheri cally symmetric spline kernel from iMonaghan & Lattanziq 
( 1985), which is also used in TreeSPH for force calculations. It has 
the form 



w(r, e) 



+ 







< r < e 
e < r < 2e 
r > 2e, 



(2) 



which vanishes beyond the radius 2e and has a smooth gradient 
everywhere. This density kernel is an effective low-pass filter that 
suppresses fluctuations on scales smaller than 2e (k > 7r/e). 

For each gas particle we assume a universal hydrogen frac- 
tion of 0.76 to convert the baryon density to hydrogen density, and 
calculate the ionization equilibrium Hi density at the particle tem- 
perature. In principle, LOSs may be sampled in any random di- 
rection, but for computational simplicity we assign the Hi density 
on a grid of 256 3 nodes, and then extract one-dimensional fields 
randomly from this grid. We have tried a higher-resolution grid of 
512 3 nodes, and the results are not affected on scales above 0.6 
/i -1 Mpc (k < 10 h Mpc -1 ). Node temperatures and velocities are 
also assigned as weighted averages of contributing particles. The 
weight is proportional to the Hi mass contribution of each particle. 

The assumption of ionization equilibrium certainly breaks 
down in very dynamic regions such as shocks. However, since the 
equilibrium Hi fraction calculated in such regions is already con- 
siderably lower than elsewhere, there will not be much of an effect 
on simulated Lya forests, even if additional shock physics can fur- 
ther reduce the Hi fraction by orders of magnitude. In addition, 
shock fronts, unlike shocked gas, only occupy a small fraction of 
the total simulation volume, so they could not have too much im- 
pact on the Lya forest. 

With the Hi density along the LOS, one can determine the Lya 
optical depth r and transmitted Lya flux F of each pixel (each 
node of the density grid). The mean flux F of the Lya forest is 
constrained by observations. We adjust the intensity of the UV ion- 
ization background Tuv so that the mean flux of all pixels in the 
simulations follows 



F(z) 



exp [-0.0032 (1 + 2 ) 3 - 37±0 - 2 ] 1.5 < 2 < 4 

0.97 - 0.025 z ± (0.003 + 0.005 z) < z < 1.5. 



(3) 



The high-redshift part of the mean flux formula is given by the 

1 http://www-hpcc.astro.washington.edu/tools/tipsy/tipsy.html 
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Table 1. Parameters of the simulations. 



Model 


Type 


n 


n h 


n A 


h 


n 


0"8 


HLCDM 


Hydro. 


0.4 


0.05 


0.6 


0.65 


0.95 


0.8 


TCDM 


N-Body 


0.3 


0.04 


0.7 


0.7 


1.1 


0.8 


LCDM1 


N-Body 


0.3 


0.04 


0.7 


0.7 


1.0 


0.8 


LCDM2 


N-Body 


0.3 


0.04 


0.7 


0.7 


1.0 


1.0 


OCDM 


N-Body 


0.3 


0.04 





0.7 


1.0 


0.8 



With the exception of HLCDM, the baryon density is used only for gener- 
ating the initial mass PS. 



Table 2. Methods for generating the Lya forest. 



Method 


Particle 


Ph ^node 


r 


HYDRO 


SPH 


SPH 


Ion. Eq. 


BA-TE-IE 


SPH 


Thermal Eq. 


Ion. Eq. 


DM-TE-IE 


CDM 


oc Thermal Eq. 


Ion. Eq. 


DM-EOS 


CDM 


«Pd To(pb/Pb) 7_1 


tx (Pb/Pb)* 3 



observations of iKim et al ] <2002ft. which is consistent with others 
iLu et al]fl996t iRauch et al.lll997l iMcDonald et alJl200(t) . Since 
the mean opacity of the low-redshift Lya forest is somewhat uncer- 
tain JPenton. S tocke and Shulll 2004t) . we take the simulated mean 
flux from lDave^^n " ^99^r as the fiducial mean flux at low red- 
shift. Thermal broadening is added afterward using the temperature 
of each pixel. Note that thermal broadening smoothes out small- 
scale fluctuations in the Lya forest without altering the mean flux 
very much. Therefore, it preferentially reduces the flux power on 
small scales. 

There is a slight inconsistency in that HLCDM has already 
included the UV ionization background, yet we need to adjust 
the intensity of the UV radiation on outputs of the simulation to 
fit the mean flux. This inconsistency does not significantly affect 
the results that follow because the temperature of the intergalac- 
tic medium (IGM) is not sensitive to the UV background inten- 
sity ICroft et alj|l997l) . In fact, the simulation outputs are able to 
reproduce the ob served mean flux with their internal UV ioniza- 
tion background JPave et al.ll999l) . External adjustments are only 
needed to vary the mean flux within the given observational and nu- 
merical uncertainties. Thus, even if the intensities of the externally 
adjusted UV background were used internally in the simulations, 
the LOS Lya absorption would not change appreciably. 
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Figure 1. Transmitted Lya flux based on baryon and dark matter distribu- 
tions at z = 0. The three panels compare Lya forests generated from the 
same LOS with methods HYDRO, BA-TE-IE, DM-TE-IE, and DM-EOS. 
All four methods are required to reproduce the same mean flux of 0.97. 

iHui & Gnedirll 1997ft . Since the Lya optical depth is proportional 
to p\ T -0 ' 7 in regions around the mean density, one finds 

F ~ e~ A(Ph/Pb)l3 ~ e - A (Pd/Pd) ; ( 5 ) 

where A <x fig r^T -0 - 7 , j3 = 2.7 - 0.77, and p d is the dark 
matter density. The constant A is often left as a fitting parameter 
adjusted to reproduce the observed mean flux. 

For comparison, we devise another method for generating Lya 
forests from hydrodynamical simulations, in which the temperature 
of the gas particle is calculated assuming that the baryons are in 
thermal equilibrium, i.e. we discard the actual particle temperature 
from the simulations. We refer to this method as BA-TE-IE, and 
the name HYDRO is given to the full-hydrodynamical approach 
described in Section l2~T1 One can assess the importance of shocked 
gas by comparing the method HYDRO with BA-TE-IE, while the 
difference between methods BA-TE-IE and DM-TE-IE must arise 
from differences in the baryon and dark matter distributions. The 
four methods are summarized in Table|2| 



2.2 Pseudo-Hydro Techniques 

IPetitiean. Miicket & Katesl i 1995ft developed a pseudo-hydro tech- 
nique for generating Lya forests from TV-body simulations. They 
assume that the baryons trace the dark matter and calculate the opti- 
cal depths of baryons assuming ionization equilibrium. We further 
simplify their method by also assuming thermal equilibrium (la- 
belled as DM-T E-IE in Tabl e d. 

Separately, ICroft et all i 1998ft proposed a slightly different 
pseudo-hydro technique (labelled as DM-EOS). In addition to as- 
suming baryons to trace dark matter, they also make use of the fact 
that, in thermal equilibrium, the equation of state (EOS) of the IGM 
gives rise to an approximate temperature-density relation 

T = T {p h /p h y~\ (4) 

where T ~ 10 4 K, 1.3 < 7 < 1.6, and p h /p b < 10 



2.3 Comparison 

To give a visual impression of pseudo-hydro techniques, in Fig- 
uresQand[2]we present Lya forests obtained along the same LOS 
using the four methods, HYDRO, BA-TE-IE, DM-TE-IE, and DM- 
EOS. We require that the mean flux over all 256 2 Lya forests in 
all four methods match the mean flux of 0.97 at z = and 0.71 at 
z = 3, but the mean flux of a single LOS is not necessarily the same 
across the methods. Since neither a simple EOS nor thermal equi- 
librium takes into account t he substantial amount of warm-hot in- 
tergalactic mediu m (WHIM. lDave et alll999tlDave & TriprJ200lt 
iDave et alj2"00lh at z = 0, pseudo-hydro techniques are expected 
to be less accurate at lower redshift. This is seen in Figure □ Con- 
versely, at z — 3 methods HYDRO and BA-TE-IE generate nearly 
identical Lya forests, and the difference between the Lya forests 
generated from baryons and those from dark matter is also small. 
Figure|3]evaluates the statistical performance of pseudo-hydro 
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Figure 2. The same as Fig.Q except that the Lya forests are generated from 
baryon and dark matter distributions at z = 3 and the mean flux is 0.71. 
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Figure 3. Flux PSs of Lyct forests at z = 0, 1, 2, and 3. The Lya forests 
are produced using the four methods listed in Tablel2l Grey bands represent 
standard deviations of flux PSs of Lya forests generated using the method 
HYDRO. The standard deviations are calculated among 1000 groups, each 
of which consists of 64 LOSs. Additional flux PSs (dash-dotted lines) are 
calculated using the method DM-EOS with T = 15000 K for z = 1, 
2, and 3. Note that the flux PSs are plotted in dimensionless form, i.e. 

fcP F (fc)/7T. 



techniques using flux PSs, and the fractional errors relative to the 
method HYDRO are shown in Figure [4] The grey bands are the 
standard deviations of the flux PSs for Lya forests produced using 
the method HYDRO. The standard deviations are calculated among 
1000 groups, each of which contains 64 LOSs randomly selected 
with no repetition. The total length of 64 LOSs is 180000 km s" 1 
at z = 3, about 10% less th an the corresponding low resolution 
sample in ICroft et ail 120021) . There is a good agreement among 




10 1 
k (h Mpc- 1 ) 

Figure 4. Fractional errors in the flux PS. The legends are the same as in 

Fig.m 



all methods at z — 3 for k less than a few h Mpc -1 with a less- 
than-10% difference in the slopes of the flux PS. Whereas, all the 
three pseudo-hydro methods, BA-TE-IE (solid lines), DM-TE-IE 
(dashed lines), and DM-EOS (dotted lines) fail to converge on HY- 
DRO (grey bands) at z = owing to the WHIM. In fact, methods 
HYDRO and BA-TE-IE have identical baryon distributions, so that 
the difference in their flux PSs can only be attributed to the IGM 
temperature, which is greatly affected by shock heating at low red- 
shift. Hence, one can conclude that the temperature structure of the 
IGM is critical to the low-redshift Lya forest and flux PS. Further- 
more, the sensitivity of the low-redshift Lya forest to hydrodynam- 
ical effects forewarns us of the importance of other astrophysical 
effects, which could make the low-redshift Lya forest an ideal test 
for realistic hydrodynamical simulations. 

The mean-density temperature of the IGM, To, does not alter 
the optical depth in the method DM-EOS because it is absorbed into 
the constant A in the approximation F = exp [-A(p/p) /3 ], which 
is adjusted to fit the observed mean flux. However, To can affect 
simulated Lya forests through thermal broadening as indicated by 
the fast drop at large k of the flux PSs for the method DM-EOS. To 
test this, We reproduce Lya forests at z — 1, 2, and 3 using To = 
15000 K, which is 1.5 to 2 times the mean-density temperature of 
the IGM in HLCDM. Flux PSs of these Lya forests are shown in 
dash-dotted lines in Figures[3]and[4] One sees that the higher mean- 
density temperature reduces more flux power on small scales while 
leaving flux PSs unchanged on large scales. 

The poor performance of the pseudo-hydro techniques at low 
redshift means that there will be a substantial systematic error in 
the recovered one-dimensional linear mass PS if it is obtained by 
applying the pseudo-hydro ratio between the one-dimensional lin- 
ear mass PS and flux PS to the observed low-redshift flux PS. For 
example, at z — 2 the slope of the flux PS of the method DM- 
EOS differ from that of HYDRO by 32% to -19% (rms 17%) 
within 0.3 h Mpc -1 < k < 2 h Mpc -1 , yet both flux PSs have 
the same underlying one-dimensional linear mass PS. Thus, the 
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Figure 5. Left panel: The neutral hydrogen number density njji as a func- 
tion of the baryon density contrast Pb/pb- The grey dots correspond to the 
values of 2.5% gas particles in the simulation HLCDM that are calculated 
using the method HYDRO, and the solid line is given by thermal equilib- 
rium and ionization equilibrium, i.e. the method BA-TE-IE. From top to 
bottom, the three horizontal dashed lines mark the Hi number densities that 
would give rise to a pixel flux level of 0.01, 0.71 (the mean flux at z = 3), 
and 0.99, if the Hi number densities were Hi number densities of the node. 
Right panel: Fractional error in the flux PS. The grey band represents the 
standard deviation of the flux PS of Lya forests generated using the method 
HYDRO as in Fig. [3] and the lines are flux PSs of Lya forests generated 
using the method BA-TE-IE (solid line), BA-TE-IE for Pb/pb > 1 antl 
HYDRO for p b /p"b 5? 1 (dashed line), and HYDRO for p b /p"b > 1 and 
BA-TE-IE for p b /p~b < 1 (dotted line). 



DM-EOS method will recover a one-dimensional mass PS that 
is 32% to -19% off compared to HYDRO. Since the slope of 
the one-dimensional mass PS determines the shape of the three- 
dimensional mass PS (the amplitude has to be calibrated sepa- 
rately), the error in the slope will give rise to an error in the shape 
of the recovered three-dimensional linear mass PS. 

Pseudo-hydro techniques replace the complex distribution of 
the neutral hydrogen number density nm at a given baryon density 
contrast pb I pb with a single function (see the left panel of Figure 
This approximation has two effects: 1) it decreases (increases) 
the optical depth of some particles and depresses (amplifies) flux 
fluctuations, and 2) it reduces the scatter in the optical depth at a 
given density and smoothes the flux. The former is more important 
at low densities where pseudo-hydro techniques tend to overesti- 
mate the optical depth, while the latter is more important at high 
densities. This is supported by Figure [2] in which pseudo-hydro 
fluxes display richer structures and deeper absorptions than the full- 
hydro flux in regions above the mean flux. 

Around k — 10 h Mpc -1 , there is a relative increase of the 
flux PS from methods BA-TE-IE and DM-TE-IE with respect to 
that from HYDRO in all the redshift panels in Figure [4] This ap- 
pears to be the result of the competition between the increase of the 
optical depth at low densities and the reduction of the scatter of the 
optical depth at high densities in the pseudo-hydro methods. The 
flux PS from the method DM-EOS shares the same characteristics 
at 2 = 3, but stronger thermal broadening at lower redshift wipes 
out the irregularity on small scales. 

To try to isolate whether it is the low or high density regions 
that are responsible for the discrepancies in the pseudo-hydro flux 
PS, we consider what happens when one applies pseudo-hydro to 
one density regime and full hydro the rest. We show in the right 
panel of Figure|5|the fractional error in the flux PS obtained by ap- 
plying the method HYDRO to pb/pb ^ 1 particles and BA-TE-IE 
to Pb/ Pb > 1 particles (dashed line). With such a combination, 
the small-scale flux fluctuations are suppressed because full hydro 
produces shallower absorptions in low density regions and because 
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Figure 6. Lya forests generated from dark matter distributions with differ- 
ent EOSs. The Lya forests are produced from dark matter densities using 
F = exp[— A(p/ p)&\, where A is adjusted to fit the mean flux F. Thermal 
broadening is included with temperature given by T = Tq(j>/ p)1 . 



pseudo-hydro eliminates those fluctuations that arise from the scat- 
ter of the optical depth in high density regions. Conversely, the op- 
posite combination (dotted line) results in a boost of the flux PS on 
small scales. It is also interesting to note that the large-scale flux 
PS (k < 2 h Mpc -1 ) is determined by the method that is applied 
to the low-density particles. Hence, Figure|5|suggests that the low- 
density particles and their treatment carry a considerable weight in 
the Lya flux PS on all scales. 

2.4 Tuning the Equation of State 

The equation of state (EOS) maps density fluctuations to flux fluc- 
tuations by relating optical depths to densities. For a given density 
and mean flux, different EOSs will assign different optical depths, 
which will then alter the amplitude of the flux fluctuations and, 
therefore, the flux PS. 

For a stiffer EOS, i.e. a smaller value of j3 (larger 7), high- 
density regions have to absorb less Lya flux, while, in compen- 
sation, low-density regions have to absorb more flux. In terms of 
flux, a stiff EOS leads to higher fluxes in deep (or large-equivalent- 
width) absorptions and lower fluxes in shallow absorptions than a 
soft EOS. This expectation is confirmed in Figure [5] where Lya 
forests generated using the method DM-EOS are compared with 
those using the method HYDRO at z = 0, 1, 2, and 3. The mean 
flux is kept the same for both methods at each epoch, varying only 
the EOS. The value of /3 = 1.4 in the figures corresponds to a very 
stiff EOS, i.e. 7 = 1.86, and it is provided only for the purpose of 
comparison. 

Figure |6| shows that low-amplitude and small-scale fluctua- 
tions in the flux are likely to be suppressed by the method DM- 
EOS. This reduces the flux PS on small scales as seen in Figures|5| 
and [4] The method DM-EOS is not a good approximation at low 
redshift, but it improves as redshift increases. 
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Figure 7. Flux PSs of Lya forests generated from dark-matter-converted 
baryon densities using different EOSs. Grey bands represent standard devi- 
ations of the flux PSs of Lya forests generated using the method HYDRO 
as in Fig.0 Also as in Fig.l3ldimensionless PSs are plotted. 

Since the amplitude of flux fluctuations increases with f3 in 
Figure[6] a smaller value of (3 must lead to a lower flux PS. This is 
observed in Figure where flux PSs of Lya forests obtained us- 
ing the method DM-EOS with different EOSs are compared with 
those using the method HYDRO. Figure demonstrates that one 
cannot tune the EOS to make the pseudo-hydro method DM-EOS 
work at low redshift. Again, the method DM-EOS appears to be a 
reasonable approximation for studies of the flux PS at z = 3, al- 
though it may not be true for higher-order statistics. The difference 
among different EOSs is also less pronounced at z = 3 because the 
dynamic range of the density contrast, p/p, is much smaller. 



3 MASS STATISTICS VS. FLUX STATISTICS 
3.1 Power Spectrum 

The Lya forest has been used to infer the linear mass PS of the cos- 
mic density field. The nonlinear transform of the density to the flux 
has made it difficult to derive the (linear) mass PS from the flux PS 
analytically. One way to circumvent this difficulty is t o use simu- 
lation s to map the flux PS to the linear mass PS (e.g. lCroftet all 
120021) . Although the flux PS resembles the linear one-dimensional 
mass PS, the underlying nonlinear density field is what produces 
the Lya forest. As such, it is important to compare the flux PS with 
the mass PS. 

Plotted in Figure[8]are flux PSs produced using methods HY- 
DRO and DM-TE-IE along with one-dimensional mass PSs of 
baryons and dark matter. The standard deviations of baryon flux 
PSs and mass PSs are shown in grey bands. The most prominent 
feature is that one-dimensional mass PSs have much larger dis - 
persions than flux PSs. As discussed in lZhan & Eisensteinl 120051) . 
the variance in the one-dimensional mass PS is severely inflated 
by the trispectrum of the cosmic density field because of the non- 
Gaussianity. 

An interesting observation is that unlike the mass PS the flux 
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k (h Mpc" 1 ) 

Figure 8. Flux PSs of simulated Lya forests and one-dimensional mass PSs 
of the underlying density fields at z = and 3. The Lya forests are pro- 
duced with methods HYDRO and DM-TE-IE from baryon and dark matter 
distributions, respectively. 

PS decreases with time. This is due to the thinning of the Lya forest 
and the higher mean flux toward lower redshift that reduce fluctua- 
tions in the Lya flux. 

The nonlinear transform between baryon density and flux 
greatly suppresses the fluctuations. For example, the overdensity 
S may vary from -1 to hundreds (tens) at z — (z = 3), but the 
flux can only be between and 1. With a mean flux on the order 
of unity, fluctuations in the flux are 10 to 10 2 times smaller than 
those in the cosmic density field. Hence, the flux PS is a factor of 
10 2 (z = 3) to 10 4 (z — 0) times lower than the one-dimensional 
mass PS. Moreover, the non-Gaussianity in the cosmic density field 
is also strongly suppressed in the flux. Thus, the flux trispectrum is 
much closer to zero as compared to the mass trispectrum of the 
cosmic density field, and the variance of the flux PS becomes much 
smaller than the variance of the one-dimensional mass PS. 

The near-Gaussian Lya flux is probably the reason that many 
simulations and techniques are able to reproduce lower-order statis- 
tics of the observed Lya forest, especially at high redshift. Fig- 
ure|8|points out a possible problem that can arise: one could pro- 
duce Lya forests from wildly different density fields but still have 
almost identical flux PSs. For example, even though baryons and 
dark matter differ considerably in terms of mass PS (see also Fig- 
ures El and^J, they are not so distinguished from each other in 
flux PSs at 2 ^ 2. Conversely, we are able to measure the flux PS 
extremely well, but the underlying mass PS may still be much less 
constrained. 



3.2 Covariance 

The covariance of the PS is a fourth-order statistic that measures the 
uncertainties in the PS as well as the correlation between modes. 
Here, we use it to explore the difference between Lya forests gen- 
erated using the full-hydro method HYDRO and those using the 
pseudo-hydro method DM-TE-IE. 

The covariance of the one-dimensional mass PS is defined as 
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Figure 9. Covariances of one-dimensional baryon and dark matter PSs at 
z = 0. The upper panels are reduced covariances C'(k, k') in a linear grey 
scale with black being 1.2 and white less than or equal to 0. The lower 
panels are cross sections of normalized covariances C(k, k') along Q = 
(fc+fc') //i _1 Mpc. The covariances C(k,k') are multiplied by 64 for better 
comparison with that of GRFs, which follows 64 C(k, k') = 5 K , . All the 
covariances are calculated from 1000 groups, each of which consists of 64 
LOSs (TV = 64) randomly selected from the density grid of HLCDM. 
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Figure 10. The same as Fig. |9| but for flux PSs of hya forests generated 
from baryons and dark matter using methods HYDRO and DM-TE-IE, re- 
spectively. 
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Figure 11. The same as Fig.|9| but for the simulation HLCDM at z = 3. 
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Figure 12. The same as Fig. II II but for flux PSs. 

a 2 1D (k,k') = ([Piu(k) - <Pl D (fc)>][PlD(fc') - (PlD(fc')}]), (6) 

where (. . .} stands for an ensemble average, and Piu(k) can be 
replaced by Pp(fc) for the flux PS covariance ap(k, k 1 ). Since we 
use a discrete Fourier transform for the analysis, the wavenumber 
k is discrete, i.e. k = 2nn / L, where n assumes integer values and 
L is the length of the spectrum. We use k and n interchangeably. 

There is a hidden variable N, the number of LOSs that are 
averaged over to obtain the one-dimensional PS, in equation ^6}. 
For Gaussian random fields (GRFs), one can show that 
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Figure 13. The same as Fig. 1 121 but for observed Lya forests. The covari- 
ances are calculated from 27 segments of Lya forests, i.e. 27 groups with 
N = 1. Note that the resolution of the observed Lya forests is about four 
times lower than that in the simulations. 

^(U'l^PmWt, (7) 

where 5^ n , is the Kronecker delta function. This also applies to 
the flux PS covariance. Equation is only approximate owing to 
both t he finite length of the LO Ss and the correlation between the 
LOSs iZhan & Eisensteirl2005h . 

We also introduce the normalized covariance 

C(k,k') =af u (k,k')lPm(k)P 1D (k')]-\ (8) 

and the reduced covariance 

C(k, k') = C(k, k')[C(k, k)C(k\ fc')]" 1/2 . (9) 

Again, Piu(k) can be replaced by Pf(/c) for the flux PS covari- 
ance. For GRFs, both the covariance matrices are diagonal. In ad- 
dition, we have NC(k, k) — 1. The advantage of C(k, k') is that 
C(k, k) — 1 for all fields, so that they can be compared with each 
other in a single grey scale. 

Figures l9l and fTol illustrate the covariances C(k,k') and 
C(k,k') of one-dimensional mass PSs and flux PSs at z = 0. 
The covariances are calculated from 1000 groups, each of which 
consists of 64 LOSs (TV = 64) randomly selected from the den- 
sity grid of HLCDM. For GRFs, the covariance matrix C(k,k') 
is diagonal, and the normalized variance C(k, k) equals TV" 1 . For 
better comparison, the covariances C(k, k') are multiplied by TV, 
so that the Gaussian case has TV C(k, k') = 6% n , . As already seen 
in IZhan & Eisensteinl 120051) , the covariances of one-dimensional 
mass PSs are starkly non-Gaussian. The variances in the one- 
dimensional mass PS are two orders of magnitude higher than ex- 
pected for GRFs. The covariances of baryons are roughly a factor 
of 2 lower than those of dark matter. This is likely due to the pres- 
sure experienced by the SPH particles. The covariances of flux PSs 
have a dominant diagonal, though they are still not Gaussian. The 
method HYDRO gives rise to stronger correlations between high-fc 
modes in the flux PS than the method DM-TE-IE (as well as BA- 
TE-IE, which is not shown) because the simple EOS (or thermal 
equilibrium for BA-TE-IE) is not sufficient to describe the WHIM. 

Figures fTT1 and ll2| present the covariances of one-dimensional 
mass PSs and flux PSs at z = 3. At this redshift, the covariances 
of one-dimensional mass PSs are reduced by a factor of a few, but 
they are still highly non-Gaussian. Whereas, the covariances of flux 
PSs are very close to Gaussian. The difference in the covariances 
between the two methods HYDRO and DM-TE-IE is significantly 
reduced compared to that at z = 0. 

In addition to simulations, we show in Figure [HI the co- 
variances of observed flux PSs at z = 3. The sample of 
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Figure 14. Mass PSs of baryons and dark matter and flux PSs of simulated 
Lya forests for five cosmological models at z = 0. The upper left panel 
shows one-dimensional mass PSs, and the lower panel three-dimensional 
mass PSs. The upper right panel shows flux PSs, and the lower panel resid- 
uals of flux PSs with respect to the flux PS of Lya forests generated using 
the method HYDRO from HLCDM (light grey lines and bands). All other 
flux PSs are from TV-body simulations using the method DM-EOS. 

Lya forests includes 20 QSO spectra from iBechtold ll994h and 
iDobrzvcki & Bechtolol ll99rJ) . The QSO spectra are selected so 
that each contains at least one good chunk of spectrum that has no 
bad pixels or strong metal lines and spans 64 A anywhere within 
z — 2.9-3.1. The spectral resolution is 1 A, which is about four 
times lower than that in the simulations. In all, there are 27 seg- 
ments of Lya forests for analysis. We do not re-group the segments, 
i.e. N = 1, in calculating the covariances. 

The main characteristics of the observed covariances are in 
good agreement with simulated ones. Namely, the covariance ma- 
trices have a strongly dominant diagonal, and they are very close to 
Gaussian. The values of diagonal elements roughly match those in 
the simulations but the off-diagonal elements are noisier owing to 
the small sample size. With a large number of high-resolution Lya 
forests, one will be able to study the behavior of the covariance on 
smaller scales (larger k) and reduce statistical uncertainties. 

A general observation of the covariances of flux PSs is that 
the correlation between two LOS modes decreases away from the 
diagonal, because two neighboring modes are more likely to be 
correlated than two distant modes. In most cases the correlation 
between modes and the variance of the PS increase toward small 
scales, over which the underlying density field is also more nonlin- 
ear and non-Gaussian. Beyond these points, however, the behavior 
of the covariances is not quantitatively understood. 



4 COSMOLOGY 

Because of the difficulty in deriving density statistics from flux 
statistics, one often resorts to numerical simulations and constrains 
cosmology by comparing observed flux statistics directly to simu- 
lated flux statistics. In addition, one utilizes fast TV-body simula- 
tions and pseudo-hydro techniques in order to explore a large cos- 
mological parameter space in manageable time. This necessitates 
an examination of the accuracy of pseudo-hydro techniques and 
the sensitivity of flux statistics to cosmology. 

Figures fT4l and ll5l compare mass PSs and flux PSs for five sim- 
ulations: HLCDM, LCDM1, high normalization LCDM (LCDM2), 
tilted LCDM (TCDM), and open CDM (OCDM). Table □ lists 



© 0000 RAS, MNRAS 000, 000-000 



Flux Power Spectrum and Covariance 9 




Figure 15. The same as Fig. 1141 except that all PSs are at z = 3. The 

observed flux PS is measured from 27 segments of Lya forests between z = 
2.9 and 3.1. The uncertainties of the observed flux PS can be inferred from 
Figure [T3l The wavenumbers labelled on the top are only for the HLCDM 
model. 



the parameters for all these models. The iV-body simulations all 
have the same box size of 22.222 /i _1 Mpc on each side and 
evolve 128 3 CDM particles from z = 49 to using GADGET 
ISpringel. Yoshida & Whitell200ll) . The initial conditions of these 
simulations have the same Fourier phases. Note that the TCDM 
model has an opposite tilt than HLCDM. Not all the simulations 
are consistent with most recent observations and they are provided 
only for testing the cosmological dependence of the flux PS. 

Pseudo-hydro techniques have already been proven inaccurate 
at low redshift by several tests above. We include the results at z = 
here only to show that all the flux PSs based on the method DM- 
EOS are nearly indistinguishable from each other except the high 
normalization model LCDM2. 

At 2 = 3, the flux PS of the OCDM model departs from others 
at k > 3 h Mpc - . However, this difference is not much more pro- 
nounced than those between the flux PSs obtained from the same 
simulation (HLCDM) but using different methods (see Figure [4j. 
Moreover, if the flux PS is simply a linearized one-dimensional 
mass PS, one may expect that the order of the mass PS amplitudes 
should be preserved in the flux PS, but this is not observed in Fig- 
ure ^] For example, the initial mass PS of LCDM2 (dotted lines) 
has the same shape as that of LCDM1 (dashed lines) but with a 
56% higher normalization. This relative amplitude is preserved in 
the nonlinear three-dimensional PS and one-dimensional PS. How- 
ever, as seen in the lower right panel, the flux PS of LCDM2 de- 
clines from 20% higher to 10% lower than that of LCDM1 from 
k = 0.002 to .04 km~ 1 s. This result i s roughly consistent with 
that reported bv lMcDonald et all l2004bh . who see a decline from 
6% to -1% in the flux PS over the same range if the initial mass PS 
is boosted by 10%. 

Without the detailed knowledge of the state of the IGM, one 
may confuse the differences between cosmological models (Fig- 
ure 1 1 5 i with the systematic errors of the pseudo-hydro methods 
(Figure [4j- Therefore, to do precision cosmology with the Lya 
forest without overly relying on hydrodynamical simulations, one 
should, at least, have precise calibrations of pseudo-hydro tech- 
niques. 



5 CONCLUSIONS 

Using hydrodynamical simulations and iV-body simulations we 
find that pseudo-hydro techniques are able to reproduce the flux 
and flux PS at k greater than a few h Mpc -1 that are obtained us- 
ing the full-hydro method at z = 3. There is also a good match 
between observed and simulated flux statistics such as the flux PS 
and its covariance at z = 3. Since the performance of pseudo- 
hydro techniques improves toward higher redshift, we expect them 
to work even better at z > 3. 

For pseudo-hydro techniques, the mean-density temperature 
of the IGM does not affect the mean flux of the Lya forest but 
it does alter the flux PS on small scales (k > several ZiMpc -1 ) 
through thermal broadening. The EOS of the IGM modifies both 
the amplitude and shape of the flux PS. We also observe a signif- 
icant evolution in the shape of the flux PS from z — to 3 (e.g. 
Fig.EJ. 

The accuracy of pseudo-hydro techniques does not seem to be 
high enough for determining the Lya flux PS at a few percent level. 
One needs to precisely calibrate pseudo-hydro techniques with hy- 
drodynamical simulations. Moreover, it is better to constrain cos- 
mology using the flux PS on scales above a few /i _1 Mpc to reduce 
the uncertainties caused by the incomplete knowledge of the IGM. 

To infer the one-dimensional linear mass PS one often divides 
the observed flux PS by the ratio between the simulated three- 
dimensional flux PS and th e theoretical linear mass PS . This proce- 
dure is widely tested fe.g. lGnedin & Hamilton 2002). In this way 
the sample variance error in the mass PS of the underly density field 
is avoided. 

The transform from density to flux quenches fluctuations by 
orders of magnitude and leads to near-Gaussian Lya fluxes. Hence, 
the variance of the flux PS is much less than that of the one- 
dimensional mass PS. In other words, one can measure the flux PS 
to a high precision with a relatively small number of LOSs but the 
underlying mass PS cannot be determined as precisely as the flux 
PS. Therefore, a large number of LOSs are needed to reduce the 
sample variance error in the one-dimensional mass PS, e.g. with- 
out binning the modes the standard deviation of the mean mass 
PS of 1024 L OSs is roughly 17% in a simulated cosmic density 
field at z = 3 IZhan & Eisensteir|2005h . Since the sample variance 
error in the one-dimensional mass PS is approximately inversely 
proportional to the number of LOSs, attempts to recover the three- 
dimensional mass PS accurate to 5% may require more than 10,000 
LOSs. Such a large number of LOSs is very demanding, but is still 
within the reach of the Sloan D igital Sky Survey (SDSS). For in- 
stance. lMcDonald et af]j2004fj) have used more than 3000 z > 2.3 
quasar spectra from the SDSS (over roughly a quarter of the tar- 
geted sky coverage) to estimate the linear mass PS. Thus, it is rea- 
sonable to project that there will be more than 10000 quasar spectra 
available when the SDSS finishes. Conversely, one can also trade 
resolution with precision by binning the modes and mitigate the 
demand for LOSs, even though binning highly correlated Fourier 
modes in the density field is not as efficient in reducing the sample 
variance error as binning independent ones. 

The growing nonlinearity and non-Gaussianity at lower red- 
shift drives up the cosmic variance of the mass PS and the cor- 
relation between different modes in the density field. This means 
that even more LOSs are needed to extend the Lya flux PS anal- 
ysis to low redshift. Fortunately, there are far more low-redshift 
quasar spectra available than high-redshift ones, although there will 
be many other astrophysical and observational challenges to be 
addressed. One such challenge is the inadequacy of the pseudo- 
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hydro techniques at low redshift (Figure[3j, when the shock-heated 
WHIM greatly alters the temperature-density relation of the IGM. 
A recent comparison between the HPM and full hydro methods 
confirms that it is the hot-phase gas t hat causes the differences 
between full and pseudo hydro results Haehnelt & Springell 

120051) . Thus it seems inevitable that time-consuming hydrodynam- 
ical simulations are needed to accurately model the low-redshift 
Lya forest and to provide the means for inferring the mass PS and 
cosmological parameters. 
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